Factor analysis of vocal-tract outlines derived from real-time magnetic resonance imaging data

نویسندگان

  • Asterios Toutios
  • Shrikanth S. Narayanan
چکیده

A factor analysis of vocal-tract outlines derived automatically from real-time magnetic resonance image (rtMRI) sequences has been performed. The analysis results in a compact representation of vocaltract shapes, where every utterance is represented by a small set of trajectories corresponding to weights in linear combinations of linguistically interpretable vocal-tract deformations. Vocal-tract shapes can be reconstructed with good accuracy from these trajectories. The work uses information from a significantly larger number of speech frames compared to previous attempts in articulatory modeling. The proposed method is illustrated through a case study of rtMRI data corresponding to 250 sentences spoken by a single speaker and underscores the promise of the methodology for phonological analysis and articulatory synthesis.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Articulatory Synthesis Based on Real-Time Magnetic Resonance Imaging Data

This paper presents a methodology for articulatory synthesis of running speech in American English driven by real-time magnetic resonance imaging (rtMRI) mid-sagittal vocal-tract data. At the core of the methodology is a time-domain simulation of the propagation of sound in the vocal tract developed previously by Maeda. The first step of the methodology is the automatic derivation of air-tissue...

متن کامل

Characterizing vocal tract dynamics with real-time MRI

Real-time magnetic resonance imaging (rtMRI) provides information about the dynamic shaping of the vocal tract during speech production [1]. We develop a dynamical system in the framework of Task Dynamics [2] which controls vocal tract constrictions and induces deformation of the air-tissue boundary. The system parameterizes the air-tissue boundary through factor analysis of rtMRI videos and ch...

متن کامل

Estimation of Vocal Tract Area Function from Magnetic Resonance Imaging: Preliminary Results

A method has been developed for three-dimensional reconstruction of the vocal tract shape and for the calculation of area function from magnetic resonance imaging (MRI). MR images were acquired and analyzed for 6 German long vowels uttered by one subject. The resulting vocal tract area functions are the basis for the calculation of formant frequencies. Conformity with acoustically measured form...

متن کامل

Seeing Speech: Capturing Vocal Tract Shaping Using Real-Time Magnetic Resonance Imaging

U nderstanding human speech production is of great interest from engineering, linguistic, and several other research points of view. While several types of data available to speech understanding studies lead to different avenues for research, in this article we focus on real-time (RT) magnetic resonance imaging (MRI) as an emerging technique for studying speech production. We discuss the detail...

متن کامل

Vocal Tract Model Adaptation Using Magnetic Resonance Imaging

We present the adaptation of the anatomy and articulation of a 3D vocal tract model to a new speaker using magnetic resonance imaging (MRI). We combined two MRI corpora of the speaker: A corpus of volumetric images of sustained phonemes and a corpus with midsagittal image sequences of dynamic utterances. The volumetric MRI corpus was used for the adaptation of vocalic and (neutral) consonantal ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015